ED 319 005 



CS 010 058 



auTKOH 
TITLE 



PUB DME 
NOTE 



PUB TYPE 



Clark, Henry T. , III 

The Effect of Miount of Intervening Text on Detection 
of Semantic Inconsistencies t5y Compatent and Less 
Competeni college Headers. 
Mar 89 

18p.? Paper presented at the Mnual Meeting of the 
Itoerican saucational Research Association (San 
Francisco, C^, March 27-31, 1989). 
Speeches/Conference Papers (150) — Reports - 
Research/Technical {143) 



EDRS PRICE 
DESCRIPTORS 



IDEMTIFIERS 



HFOl/PCOl Plus Postage* 

Malysis of Variance? Coherence i Higher Edticatioii; 
«Reaaing Comprehension i Reading Processes r Reading 
Researchi ^Reading Skillsi Reading Strategiesi ^^Text 
Structure 

^Comprehension Monitoring i Reading Behavior f Te.ict 
Factors 



llBSTRi^CT 

A study eii^amined the effect of amount of intervening 
text on the detection of semantic inconsistencies and use of 
strategic backtracking ^ loy competent and less competent college 
readers. Data were elicited from 40 undergraduate students (selected 
on the basis of their high or low scores on a variety of ln?lruments) 
enrolled in an introductory course in educational psychology. 
Subjects read and ansti^ered accompanying comprehension questions for 
six passages adapted from college- level psychology tents, four 
passages containing inconsistencies^ and two normal passages as 
controls. Results indicated no difference in detection rate between 
competent and less competent t^lth sero^ twOf and four intervening 
sentences • With eight intervening sentences # conpetent readers 
detected significantly isore inconsistencies than less competent 
readers. Results also reveaj.ed similar levels of strategic 
backtracking by competent and less competent readers with sero 
intervening sentences but competent readers made greater use of 
rereading with two^ four, and eight intervening sentences* (Two 
figures and one table of data are included i 15 references are 
attached . ) ( Author /KEH) 
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Ih® pmnmt stwJy imf®st^at@ci ti® ®ffect @f asrouM ©f :Tif@i¥©fii^ lest m tl^a d©!6stfep @f 
semaotte i^nstetar^s, ys@ ©f strategic bi^idrndciiig, ^ ^^mpetdnt and Pass c^mpst@^£ 
coiteg© reader. It was hypothesized that iBCressIng l©v©!s of sepamtten wsufd b© mof® 
disruptive to the ctetecllon of In^nsistefides by less ^mpetent readers. Results iodteafsd no 
difference in detection rat© between compettint aod i©ss competent with 0„ 2, arid 4 
Intervening sentences. With S intsfvenlng sentences, eompeteni readers fy^^.SS) detected 
slgniclcafitiy mor€ Inconslstencids than i@ss €or^p@tdfit (^-.50) readerSo Thasa rtssjlts ere 
discussed In mms of differsf^tSai criteria used s@i@&tlofi artd retention ef sentences in 
working memory dyring coherence testing. Whil® ajmpetsfit and l®ss ^mpetent readers 
displayed similar l§¥t,» of strategic badctracklng with 0 Intervening sentences^ competent 
readers mad© greater ys@ of rertadlng wttii 2, 4, amJ 8 jiiteirvensng sentences. 



The mec^Janlsms bf whteh readers deveJ^ s« yrKl©rslanding ©f ©sg^sitofy test remain a 
miml area ©f ste^ to edu^to araJ psy^tog^. Theories ©f eomprsHamten sodi as mm 
pF@pos®d by Kintscti C1i79, 1884), ICIntscti & vaffi Bilk {WfBh mm@mm iW7S. 
imnh Bummm & O^t^nf |19T?), aod SsfiaH@n ftss®! pfopssQ that eompretiefistofi 
Inw^h^es oonsfruc^bn of IcRowf^t thmugh tat®raetion with Ttiis process of buMing a 
coherent Isk! representation would invoive th@ eoostructlee ©f a prellrmlnary ffaf??ewrk tor 
repressotatofi ©f !h@ laxt contem, and successive etaboratfon of, and modification to, that 
r©pfes®ntatton, DffferensQs in text cofnpf@h@nsi0« between csmpeterit and less competent 
refers may rilate mt onfy to the nature of th@ fepresentatfens that readers esjnstruct, but 
also to the medmnfems readers use to assess the ade^ac^ and oohereRC® of !h® emergiJig text 
representation. 

One aspect of assessing ttie adequ^ and c^tterenoe of a text r^septatiofi wmild involve 
monitoHng tmt for a>nsls!en^. Kint^h C197S; Klntsch S van Dljk. 1978) has referred to 
tfifs es testing for pr^jositlonal o^lierence. Tests ©f pmpDsltbrial coherence w©ufd be a antral 
facet of comprehension mofiHorisii. specifically related to the evaJyatfon ^mponent of the 
comprehension monitoring process. Figure 1 presents a schematic mode! for coherence testing 
based on KIntsch (1979) and KIntsch & van Dijk (1978). According to the model, tests of 
proposltlonal cohi*rence Involve seeking overlap between new propositions and a subset of 
existing pro^^sttions that have been rstalned in a working memory buffer. The buffer is . 
assumed to be a limited capacity store: heno® only a limited numter ol propositions may be 
retained as a primary baste for c^herenee testing. The specific propositions that are retained 
&m a matter ©f selection (or c^fault) by the White several factors mf mediate whkrfi 



propositions m@ selected lor retintiosi In the buffer, t«^o impartant factors idsratlfied by 
Kintsd^ are pr^sStfon^ iii^rtanc^ and r^@f^. 

Diffemm^ that have been Served Sn the ^Ity of c^fi^t©nt aod tess TOnipelem readers 
to detect to^slstaiidas In syggest differences kk ttia cohsrence tssting pm^ss@ CB^©r. 
1979; Garner, tSSO: Gamer & Kraus. 1981-1982; Har@ & Borch^fdt, 1985; Rels & 
Sp@kman, 1933). Pdor research on strategic reading differences between competent and less 
competent readers suggest that at least ^me of the difference b qyaiitalive. Competent 
readers have been found to make greater use of text maaxsstnicture in comf^ehensbn tasks, 
arsd to focos on inlomiatlon that is of high struiisurai ^portanceo Less competent readers, on 
the other hand, tend to prccess material in smaller tilts, relying on foregrounded ^formatk)n 
to assess new rrjiterial. Less competent readers have been char^terlzed as more linear M 
their as^oach to text conprehensbn. To the extent that these chars^^terlzations of competent 
and less ojmpetem reefers to the selection of p^positk^is tor rstention to ttie buffer . 
they may lnfluen<^ the nature and effediveness of coherence testing. Speciflcaily. competent 
readers may ^ imre likely to test new information for coherence against structurally 
relevant propositions from previojsfy presented Information, while less competent readers 
may rely mora m tests of tecal «5herenc@ an^ng su^^slve, or recent, proposltfens. To the 
extent that Inconsistent information occurs consecutively In text, tests based on local 
coherence or coherence with Important propositions should be equallif effective In detecting 
the problem. Local tests of coherence, however, may be Insufficient when Inconsistent 
Information Is separated by an appreciable amount of nonoontradictory Intervening %mt (text 
separation). 
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The pflmary pufi^s© of tills research was to investigal® th© @ff@ct of t@Kt separatbn ©n 
deiec^iofi of s©maf!tlc fci^nslstendes ifi ©x|^sft©fy i@Mt by competent ami tess c^mp@t@pt 
eelieg® readeiii. Th© mnt^ ©f OTt^tsfit readtets t@ ci©t®et t®>st in^stetera^es ¥ms ^dteted to 

r@!a«v@^ yfiafffscted by t§i@ degm© of text sepsretto b©lw©in tonstetefit ssfitences. White 
less c^ffipetent m&c^m were expected ^ detect taojngryence betw©©R ©temems of Infbrmatfon 
presented consecutively, their llkeflhood ©f delecting semantic fnconsfstencfes was predtotad 
to decrease rsSatfv© to comj^tent readers with Increasing text separattor? of Inconslsterit 
sentem^s. The critical finding for th© present liypotheses, thsfsfom. would 1^ a signtont 
Re^lf^ Ability X Text Separafep Neracllon on ctetectton &c^@s. 

A secondary purpose of the present study to investigate whether comi^ d end less 
competent readers displayed different pattern of strategte bad^traddng t® reread prevfeus 
portions of text following detection of Inconsistepc^s. 

Bi^^sm,' Subjects were 40 yndergraduate students (8 male, 32 femalel enrolled li^ m 
Introductory course In educational psychology. These sul^ec^ were selected from a pool of 
228 subjects who participated In a targe group screening session. During the screening 
session, subjects were administered a variety of instruments Including the Nelson-Denny 
Reading Test {Brown. Bennet, & Hanna. 1981). Subjects whose scores on the 36-item 
comprehension portion of the Nelson-Denny were among the 20 highest (M-34.05) and 20 
lowest (M»18.S4) were selected for participation. These scores represera the upper 5th 
percentile (competent readers) and lower 25th percentile ftess eom^ietgnt rtaders^) m the 
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H^^n-Demf norms. 

MaMlM^: EKp@rlm©ntal materlets ©orts^^tdd of 6 ©KposHoey passages fap^Klmately 600 
words m^) adspted from e0t!®§©-f0v®l psychology mm. The passages ci@aSt with topics 
fslaled to matefial o^r^ in Ih© ©du^ttonai psychology mutm, ba! not spedteBy c^vsrscS 
in the students' cyfrsr«t program. Alternate versions of four ©f the passages were d@v0l@f»d 
OMitalnlng sentences that were semanlkjally inconsistent with aach other. The inconsistent 
sentences muM be placed in the seqyem^ of the text with 0, 2, 4. or 8 Intervening serter^ces. 
Although the intervening sentences wer® reSevsnt to the overall passage, they were not 
spedflcally related to the «^mradfetory Informatten, nor m Ihey Interrypt the normal flow 
of the passs^e. In light of ttie research denionstrating the mlativeiy p^r perfomianoe of 
college stuclents In detecting text-based semantic inconsistencies (Baker, 1979; Baker & 
And@rson, 19B2; Clark. Forfl? i, Ward, & Brubaker, 1388), versions of these passages vtdth 
th® if^nslstendes M oonseoith/e sentences were subjected lo multiple pibt ^sts to ensyre 
that the 0<-saparation inconsistencies were readfty detectable by competent readers. This 
pre^utlon was taken to ensof© suffident "floor room" for anf experimental effect to be 
ot^fved. 

Each passage was accompanied by three 4-chotoe muil^e dKsk^ quest^ns designed to 
assess coinprehenslon of the main Ideas in ti^e passage. One of the questions asked ^^clflcalSy 
about the Im^nslstent in^rifiatlon. Following the three comprehension questions, subjects 
were provided with a paraphrase of the Inconsistent sentence, asked whether or not that 
sentence was consistent wUh (fit in with) ©verythir^ ®Is@ that they had read in the passage, 
®mf ssksd to prpvl^ a wMm ©xampte ©f fmw thst inforfnatten ©Ittier fit ki with, m wm 



inconsistent with, other portions of the test. This question s@?v@d as a ^^fic probe for 

detectiosi of th@ inconslstiiis^. 

^resodufog: Siilj|©^s rsad all s!k pass^fts, tti© toyr passages mntainlng §iwns5st@nd@s, 
twQ ROffnai pffisag®s as mntmte. Passages were pmstoted ®to s©fit©f!c© at © Uto or? an tBM 
micrcwmpytur. Su^eets c^ntrofW nacfing tim© and irovamtnt through the t®>ct bf pmssJitg a 
pred@signal@d kQy to move elth@r to Ih© n@Mt s®nt©nc9 in the passage or bade to a prevfoos 
stntsnc©. For tti© eKparisnentai passages, re^rds ©f ©xposyre time and ssqytnee ©f ^splay of 
ttis san!enc@s w@re maintained bf th@ eonipyter. All subjects read or^e of the two controi 
passages irst to i^c^rm familiar with the es^rimanlal procedures. Ord@r of the remaining 
five passages, and amoyni of intar¥@ninp text batwsert Inainsistent ssntsnc@s» mm 
randomized with the constraint that a!i subjects re^hred one pmbSem passage ymfer each 
leveS of text separation. After eadi passage, syt^@ds answered tlie qyestions ^ut lh@ passage 
on an aamipany^ sheet bato Qoli^ onto tie next ^Missage. 



Resytis 

Although performance on the passage osmprahension test was not the central area of 
concern. totaS score across passages was anafyied to determine whether 1) subjects 
dennonstrated suffidenl attentfen to the eomprehensioft tasi? to render the data meaningfyl, and 
2) perforroanct within Ih© ©xperimental framework was consistent with the initial 
categorization of the readers Into different reading ^iiity levels. Overs!! perf^mance of both 
competent {M«10.55) and less competent cy«9.40) readers was sufficiently high ^ warrant 
omdiKflng that the st^iecls attended to tl^ task of reatf ng lor ynctersiandlng. An ANOVA of 
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TotaS C©mpr®h@nslon Scores iRdleated lt?at th@ group difference was reflabi© 

Th© d^tef data @f taterest io this r@§@aroh mm itet©ctkin smrts fer tht tonslstanefas. 
Detedkm 3f tons!st@Rdes isras *f@rfiifci«d by §yb|@cts' resp0fis©s lo f ^ spscifte prt^ ©n !h@ 
qy©stbn sheet. Sybi®eis vsrti© Imltoated ftat the paraphras^ci s©nf§nc© was Sfwnsfsten! with 
©lh©f infoffnatton presented in th@ l@Kt, ar^ pmytdod a c^r^cf®!© expianatten of the nature of 
the Ineonsistency, mm csjded as having d©!©cted the profofem. Those who Indlcaiad that the 
paraphrase was c^mslstent with other intormatlon In th@ passage w©r@ as non-det^ors. 
In three Instant, sybjet^s Indieated that the paraphrases was Jf^fisistent, Imt provide m 
enpiummt that was itot related t© the nature of the Jnconsfeterscy. These were dotted as 
ifistariees ©f fiondeteottoti. All syl^ects prcvkted easily categorlzabfr ©jspJanatlons for their 
-responses. Me^s and SD's of detection scares for oompetent and less sompetent resders for 
each ievt! of text separalbn are presents in Tab!© 1. 

DefectloR scores were analyzed yslng a 2 X 4 {Reading Ability K Text Separation) 
mixed-factor analysis of variance. Reading Ability fajmpetent vs. less competent readers) 
wsa a between sobjects fa^rs. while Text Separation (0, 4, ©r 8 Intervening sentences) 
was a within sul^ects factor. There was a significant main effect for Beading Ability 
ifiiMh9.27, p<.005), and a significant Reading Ability K Jm Ssparatlon inters, tton 
CFC3.114)»2J7, p<.m). The Interaaion is presantad In Figyre 2. Since the main effect for 
Reading Ability is contained In the Interaction, only the Interaction will be discussed. 
Nevssnan-Keute ^nlrasts In^ied no different in competent readers' detection wm^$ woss 
the four levels of text ssparalten, Thsr© was m ^ff®f®fic@ b©fw©©n TOnip®t©Rt and {®ss 
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esmp©t©nt F&aders In d^teaifig ift^sJstenetes with 0, @r 4 Ipttfvtning s©nt.5fi'^s, but f®ss 
competent readers (y«.60) psrfermecl s^filtoniiy wmm than ajmpelQfit readers 
^Mh 8 lfi!@ry©fiing s@f^l©ms. Less ^mpstent f©®d®rs' dfstec^tof! ®f iric@nsSst@nd©s with 8 
isi!©fv@fiifig seiiterices was slgolfte'jntfy tower than tfi®ir d®t®€!l0n s^r®§ at my of tti© &thm 
thrm {®v@!s of t@Kt separaHon. 

A seconda^ pyrpos© of th© present Investigation was to ijcpior© the ys@ of strategic 
bad^trackiog ^mpetanl and less OHTipstent readers In resins© to tha ten \nmt$\st@rtde$. 
Only thos® teokbac*s which oocurred at th® In^nslstent Me were anafyxed. Ttese data w@r® 
analped wsinp a 2 X 4 C^eadif^ AWflty X T®3?t SeparatfoR) mlii^ telor AMOVA. Th© a^aiysls 
F@v@aied a significant &flmt for Reading Ability {FC1 ,38)-§.37S, p»>.016| and a mdrginai 
©ffetJ for Text Separation C^P. 114)=2.540, p^.OSQ). Overall competent readers made 
greater us© of badctracklng. with a temtency for there to b® tess 6sadc*«'adc!ng ysed with 
inaeasing i©v@ls of te^t separation. Perhaps more revealing ar@ the oonditional probabilities 
©f backtracking gi¥eR detsctbn of tfie IrTOfisistency by th® tm groups over the four levels of 
tmt separation. There war retativsfy lltli@ dlffer@m;e in the conditional probability of 
badctrad^ing betw®in competent Cp«=.412) and tess competent |p«..375| readers when th© 
inconsistent sent@nca$ ©ecyrred auccessivei/. For eompeterst r@ad©rs, the oonditlonal 
probabilities declined somewhat slowly C.Sli, .278, and .26.^) with 2, 4 and 8 irtt@rv@ning 
sentences. For less competent readers, however, the conditional probabilities plumeted 
quickly (.071 . .000, and .000) when the inconsistent sentences were not consecutive, with 
only 1 instance of backtracking at 2 intei^'ening sentifises and mm st ©ither 4 ©r 8 
iiiter¥@rslii0 senttnees. Thssa data %hmM te trsa« witti eautte«t, tow©¥©r. In view ©f t5i© 
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spars® us© ©f backiradclng by %mm if@yp ef rsadere. 

and lass eof!^t@fit readers to dtted tesd-feas^ semantic toosjsttndes. 8! h^th®ste@d 
that thQ ability ef competent maders to detect Imxinsfsteficles wou^ b@ relatlv©^ ynaff®ct®d 
fey nm amoyni of text separating the {fisojislstent s®nt©RC®s, but that toss eompalenl readers 
¥kfoukS show decreased datectJon sf te^nsistendes wiifi toeasing tsjct stparatbn. The present 
results fndkjat© that ojmpetent readers were able to dtiect the lfwns!si©fid©s readily at ail 
i©veSs of separation !fw@st^at@d in th@ @M|^rlm@nlai pgr^lgm. This finding is consfstgnt 
¥^th the view that tti® gx)mprtheriston mofiSlorlng pms@sses used by 2xjm^t©nt rtadifs fe^vslv© 
th© tests of coherent b#twe@R nm Information artd retevant taformatton from the teict being 
resd. The performance of th§ oonipatent readers Indicates that tests of pfoposWona! ©)h®r©j« 
Imf0hf©d In compfehenslon monitoring wer® ysed ©ffeetlvely. md thai n^w Informatfon was 
c^fnparsd to relevant a^jeas of ii© tescl represintatlon rathar than r@slrfetfng {^mparlson to 
recent or foregrounded Information. 

Although tha i^rformance of ^he less a)mpgt@nt re^rs was compar^le to that ©f th© 
competent readers when the Inconsistent sentences ^am in proximity in the text, they 
displayed greater dlfffcutty In detecting irr^slslendes as th© distais* between Inrorislsten! 
sentences Incressdd. With 3 intarvenlng senton^s, the differenoe was both significant and 
sutetantlai. This finding is CQnsis«:«nt with the vfew that less competent re^rs rely on tTiore 
limited tests of fecal a>herence In nionltorlfig their ^fiipreti®f§si©n. In th® pr©s®nt data. 
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competent and tess «»mpsi©nt readers showed similar dgtectton scares with 0, 2 arBd 4 
Intesvertlng sentences. This suggests that, ¥^min th© sontent of the ©spertfuantal slfyattofi, 
teeal ststs ©f e0li©rifi^ w®r® suffidesi? yp t© at Sgast S s®ot®ii€®s. H©w®v©r th© dramatic 
d@cr®as© ii^ (d®t©eti©rs sc^fss amofig isss mimpsteRl readers '^tmn thm® mm B lnt©rv@iilng 
samgnees suggests that such leveSs &1 ten s@paratton exceeded th® span of local mheropc® 
tests. 

Whil® thes© results ar® consistent with pftdleilons mad© on th@ basis sf h^potliesfeed 
dlfferenees In th® satestlon of ^©positions for yse In mtmrence testing, a word of caotlon Is In 
order. Th© a>herencg testing model allows for myftlpl® passes thr@ygh th<^ Issting pro<^s§ 
using aftematlv© subsets of propositions when Initial tests fall to find synident overlap. An 
altemats eMplanstbn based on similar Initial seMlon of proposHtons by omipetont and less 
competent r@Mf@rs, but greater usa of rsairsivo fol!owi|» tests impotent rsaders, couM 
also account for th© results. Thte feisplanatloii wowld in^ addltksnal tim® on th@ part of th© 
competent readers attrlbutabte to tm gddStlonaf passes through th© testing prosess. White ths 
present investlgatton cannot rut© out the alt©mi^f@ ej^lanation, lota! reacing time data argue 
against such an explanation. Competent readers (M» 11 85.35 ticks) took substantially less 
time than less compatant readers (M^l 460.48 ticks) at th® critical 8-inl©rvenlng sensanca 
l©v®l. This, ho¥if©v@r, represents total reading time rather thart ^me span! s^lfteaffy at th® 
inconsistsnt point. AJdItlonat stydy is warrantsd to dsrify further th® r©l8 of selection 
criteria in accounting for differences In detection among oompatent and less competent 
readtrs. 

Rasults of the analysis of backtracking soggesi that ten separation infiuen^s no! only 
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deteclton of Inconsistencies, but aisc strategic repair. Whl\9 lK)tli competent and 8ess 
a .jpel^nf readers showed similar levels @f backtrackifig witli eof^secutlve Inconslstarit 
sefitenceSo i®ss competent readers ccspiayed almost um of ijacktracklrig wUh 
noo-^os&cyllv© Ins^nsisterit sapterices despite some mMQum of swareiiess ol Sti® preserse® of 
th® tne©nslsteF^4©s. While, as net®d earlier, these data should be treated with eautiofie they 
rioneth@f@ss suggest differences Irs the vi^ilfin^ness of cx>mpetent and less oompeteot readers to 
initiate repair ynder more demandifig repair cxsnditions, even wh@n thew Is recognition that 
such repalf might m desirable. 
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1 , III® terreis ^©ampitsnf and *'tess ^mpetinr ar® used hm® t® describe !h© readers 
rea>gnltton of th@ fact that ai (?) ^I®ge/ynfv®fsity yndergmduates ar® at least mffilmaily 
TOmp@t0fit tfi reading oompr@h@nslofi. At issue her® Is a comparison ef groups that differ In 
rmdlng abHIly rather thm oms thm represent rea! ejctremes ©rs a comtlnuum. 
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